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W DISTRIBUTED VIRTUAL ENVIRONMENT 

The present invention relates to a distributed virtual environment. 

Computer and video gaming has been a popular pastime ever since the 
5 first personal computers and home video game consoles arrived back in the late 
1970s. In the last two or three years the nature of these games has changed 
dramatically due to development in two technical areas. 

Firstly increasing computer power has allowed complex 3-D virtual 
environments to be modelled and displayed. These environments allow players 
10 both to move through a virtual world and to interact with the entities within it. 

Secondly the widespread growth in computer network usage and 
availability (e.g. corporate LANs and the internet) has led to many games boasting 
multi-player capabilities. 

Taken together these two developments have resulted in the basis for 
15 many games becoming a shared Virtual Environment (VE) which allow groups of 
people to either compete (e.g. shoot at each other or hunt for treasure etc.) or co- 
operate (e.g. explore or solve puzzles, business problems etc.). 

In delivering shared VEs a number of key issues as follow have to be 
addressed. 

20 The usual present day implementation of a shared VE places a local copy 

of the common environment at each client. Players interact with the local copy 
and broadcast these interactions to other clients or servers. For example, a switch 
which opens a door may be modelled as an object at each client. It has state (the 
switch position) and behaviour (it animates when toggled and instructs another 

25 object, a door, to open). Both the state and behaviour are held on each client. 
When a user activates the switch the switch not only runs the relevant behaviour 
locally but messages to all instances of the switch on other clients instructing 
them to run the same behaviour. Since changes to the environment take time to 
propagate across the network it is possible that two players may perform 

30 conflicting actions (e.g. both pick up the same object). Resolving this type of 
problem to ensure the environment seen by each player is essentially the same is 
known as maintaining 'consistency'. 
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" The time taken for information to propagate between clients is known as 

'latency' and is a key factor when trying to maintain a believable and consistent 
environment. High or variable latency can make it difficult to maintain a common 
shared view amongst all clients. 
5 If the state of a VE persists when no players are present and players can 

leave and rejoin without resetting its state then it is said to be a 'persistent' 
environment. Persistent environments normally require a server (or servers) to 
store the state of the VE. 

An ideally 'scaleable' VE is one in which the number of players within it 

10 can increase with no theoretical limit (i.e. no component of the system is a 
potential performance bottleneck). 

The above issues of consistency, latency, persistence and scalabieness 
apply generally to both gaming and non-gaming VEs. A number of additional 
issues as follow, namely balance, reuse, integrity and extensibility, are of particular 

1 5 importance to gaming environments. 

Non-shared and non-persistent VEs can be carefully controlled to deliver a 
balanced game for the player (e.g. as a player's skill improves the challenges they 
face may increase in difficulty). By contrast a persistent environment may evolve 
over months with hundreds of players influencing its development. It is therefore 

20 very difficult for the designer to control what and whom the player encounters 
during his or her game session. It may be necessary to dynamically introduce 
objects with new behaviour or modify an object's existing behaviour to maintain a 
'balanced' game that all users can enjoy. 

Many games share common characteristics and objects (e.g. missiles that 

25 may be fired by a player, switches that operate doors and pressure pads that 
trigger certain behaviour in particular objects etc.). Additionally many successful 
games have sequels produced based on the original story line and technology. 
Hence the ability to 'reuse' or carry common components between particula r 
implementations is highly valuable. 

30 For persistent gaming environments to succeed players have to trust the 

system to ensure fair play such that the system may be said to have 'integrity'. 
Few players would wish to play a game if others could cheat without fear of 
detection. 
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To create a persistent environment to which a player will wish to keep 
returning it is important that the environment can be extended and enhanced. 
Having built a community of users, 'extensibility' offers a means to retain them. 

Existing distributed VE based games have tended to bring with them the 
development legacy of single player games with networking included as an 
additional feature rather than as an integral part. Hence a typical game will work 
as discussed by providing both the graphics and game-play related behaviour at 
each client and then synchronising with other clients by broadcasting the player's 
input to all other clients. This approach lacks both scaleability (as the network 
load at each client grows with every additional client) and persistence (as the 
environment state is lost when the last client leaves). 

More sophisticated implementations add a specialised (i.e. unique to that 
game title) single central server to provide the environment state and broadcast or 
arbitrate on changes to the environments. This can provide a persistent 
environment but the single centralised server precludes scaleability. This is due to 
the fact that as client numbers increase both the server network traffic load and 
processing load increase forcing even the most powerful server to become a 
bottleneck. 

Both of these approaches tend to place not only the game engine at the 
client but also the graphics engine. Whilst this has the potential to provide an 
efficient implementation (each client is effectively custom built for each game title) 
it limits balancing of the game play over time to the fixed constraints of the release 
version of the game rules. Also by associating the game rules so closely with the 
client implementation it limits reuse of components. 

Somewhat more sophisticated examples of VE architecture have become 
apparent from a number of academic and military approaches. 



systems -has-been the -ability— to- deliver -scaleability through suitable network - 
architectures. 



Multicast network addresses may be associated with defined areas within 
the virtual environment. Changes within that area are broadcast via this address 
and clients interested in that area listen to the address to receive updates. 



The main focus of research in the VE field for academic or military 



Known approaches have included techniques as follow. 
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" Network traffic to a particular client therefore grows relative to the number o 
entities in its avatar's local area rather than in the connplete environment. Such an 
approach is described in a paper in Presence Vol 3 No. 4 1994 by Michael R 
Macadonia entitled "A Network Software Architecture for large Scale Virtual 
5 Environments". 

Alternatively, multicast network addresses may be associated with 
individual entities within the environment, which the entities then use to transmit 
their state {position or orientation etc.). As users come within range of entities 
(range being defined as awareness either visual or aural) they begin listening to the 

10 relevant network address and hence receive the current entity state. Such an 
approach may be seen in a paper entitled "MASSIVE: a Virtual Reality system for 
Teleconferencing" by Christ Greenhaigh and Steve Benford, published in ACM 
Transaction on Computer Human Interfaces, 1995. 

Both of these approaches can be enhanced with simple environment state 

1 5 servers to offer a degree of consistency and persistence. However, these known 
approaches fail to address the issues directly relevant to gaming namely balance, 
reuse and integrity. 

According to the invention there is provided apparatus for providing a 
client/server based virtual environment wherein each entity in the virtual 

20 environment is represented as a plurality of associated aspects of the entity, the 
apparatus comprising: at least one server comprising rule model managing means 
to provide a conceptual model of an entity and at least one dynamic model 
managing means to provide a dynamic model of the entity; at least one client 
comprising visual model managing means to provide a visual model of each entity; 

25 and means to allow messaging between respective ones of the rule model 
managing means, the dynamic model managing means and the visual model 
managing means to ensure consistency. 

Separation of the dynamic modelling from the conceptual model makes 
balancing and extending the game far easier. Because the complex dynamics are 

30 handled elsewhere, a game designer has a conceptual model to work with that is 
highly focused on the gameplay and the game content. Modifying and adding to 
this will not involve any changes to the dynamic or visual modelling. Hence, game 
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" designers can focus on the issues relevant to the gameplay, and not on the 
behaviour and state distribution needed to nnaintain a shared VE. 

The dynamic/conceptual/visual separation also encourages component re- 
use. The dynamic modelling required in a VE is fairly consistent, irrespective of 
5 the type of game. For example, whether the player is exploring a medieval 
dungeon or a modern office block objects still can be thrown, dropped and collided 
with. 

Hence, not only is it easy to vary an existing game, it should be simple to 
deliver a completely new game by providing a new set of conceptual 

1 0 representatives. 

The dynamic/conceptual/visual separation allows the use of different 
technical implementations for the management of the VE. For the processing 
intensive dynamic modelling, where modifications are infrequent and speed critical, 
a compiled language may be desirable (e.g. C++). For the flexible and frequently 

15 modified conceptual modelling an interpreted language (e.g. Java) may be more 
suitable. By contrast, without this type of process division, either speed or 
flexibility would have to be sacrificed. 

The embedding of many of the game rules into a conceptual model stored 
at a central server helps to reduce the upstream traffic requirement from each 

20 client. Where a client action may make a large number of dynamic changes to an 
environment (e.g. opening a door which pushes a number of objects aside), the 
client sends only a single high level request to the rule model managing means. 
This may then be mapped into a large number of dynamic state changes by both 
the rule model managing means and the dynamic model managing means. 

25 The combination of both the conceptual models (e.g. the game rules) and 

the dynamic models existing on a central server or collection of servers ensures 
the integrity and consistency of the system. Clients can only make changes to the 

V-E-once~they-have-been~authenticated-through-either-the-conceptual-modeUor-the 

dynamic model. Hence players are assured of fair play for all. If the integrity of 

30 the environment is breached through users exploiting a code bug, fixes can be 
applied on the relevant server code. This avoids the need to trust users to install 
client patches as necessary. 
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" Specific embodiments of the present invention will now be described by 

way of example and with reference to the accompanying drawings in which: 
Figure 1 represents a VE entity; 

Figure 2 represent a first network architecture according to the invention; 
5 Figure 3 illustrates messaging interaction between elements of the 

architecture of Figure 1 ; 

Figure 4 represents a second network architecture; 

Figure 5 represents communication channels between VE managers; and 

Figure 6 represents a third embodiment of the invention; 
10 Figures 7a and 7b illustrate two examples of the subdivision of the virtual 

environment into zones; 

Figure 8 illustrates an area of interest for a given zone; 

Figure 9 illustrates the movement of an area of interest; 

Figure 10 illustrates the world manager to zone manager connections for 
1 5 the arrangement shown in Figure 6; 

Figure 1 1 shows an example of zone manager interconnections; 

Figure 12 illustrates collision between two dynamic representative objects 
at a zone boundary; and 

Figure 13 illustrates a further embodiment of the invention. 
20 As discussed above, the use of so called client/server architecture is well 

known in the field of Virtual Environments (Ves). The use of object-orientated 
(OO) techniques in modelling Virtual Environments (VEs) is also well known. 

Having regard to Figure 1 it will be seen that entities in a Virtual 
Environment (VE) are presented as three distinct yet associated objects 10, 12, 14 
25 each representing a different aspect of functionality. In this way each of the 
objects are representative, in a given manner, of the complete entity. 

The Conceptual Representative Object 10 describes an entity in the VE 
with respect to its game-play specific characteristics. The desired interaction 
between instances of different objects yields the rules and goals of the game. 
30 By way of example, a gun in a game might be represented conceptually as 

a Gun Concept Object with the behaviour and state unique to a gun. A typical 
state might include "number of bullets left" and behaviours might include "pulling 
the trigger fires a bullet". However, the concept of the gun would not contain a 
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" visual model of the gun (e.g. list polygon or texture maps etc) or a model of the 
gun dynamics (e.g. position, orientation, velocity or volume etc.). 

The Dynamic Representative Object 12 describes the physical 
characteristics of entities in the VE e.g. movement, spin, collision etc. A typical 
5 state held by the Dynamic Representative Object 1 2 might be the entity position, 
orientation, weight, collision volume or velocity etc. Typical behaviour associated 
with the Dynamic Representative Object might be how the entity moves when 
thrown, dropped or it collides etc. Conceptually different entities (e.g. a gun and a 
pen) may be associated with the same type of Dynamic Representative Object 1 2 

10 but have different initial state parameters (e.g. whilst a gun and a pen are 
conceptually different they will both behave in similar fashion when thrown or 
dropped). 

The Visual Representative Object 14 provides the user representation of 
the entity. It contains the state information and behiaviour required to render the 

15 entity at a client. Typical state information held by the Visual Representative 
Object 14 might be the geometric description of the shape or the texture maps, 
sounds used etc. There is a close correlation between the types of visual objects 
and the types of dynamic objects as dynamic behaviour (e.g. a door opening) will 
have to be represented visually. However, where the dynamic model 1 2 of, for 

20 example a door, will ensure the door collides correctly with other entities as it 
opens, the visual model 14 will ensure it is rendered correctly as it rotates about 
its hinge. 

Visual Representative Object 14 may provide the user interface to entities 
by indicating a set of actions an entity can be asked to perform (e.g. "open" for a 

25 door or "pull" for a lever etc.). These actions are determined by the Dynamic and 
Conceptual Representative Objects 12, 10 respectively and requests from a user to 
perform an action map directly to a request to either of these two Representative 
Objects. For example, a gun in the VE could be moved (a request-to the Dynamic- 
Representative Object 12) or fired (a request to the Conceptual Representative 

30 Object 10). 

It is to be noted that whilst a single entity type is represented by a 
combination of three different objects 10, 12, 14, there will not necessarily be 
three unique types of object for each entity. Whilst two entities may be 
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conceptually different they might both be modelled by the same type of Dynamic 
Representative Object 1 2 and rendered by the same type of Visual Representative 
Object 14. 

For example a sword may be represented by the triplet "Sword Concept, 
5 Generic Entity Dynamic, Generic Entity Visual". Similarly a gun could be modelled 
using "Gun Concept, Generic Entity Dynamic, Generic Entity Visual", This 
principle extends to entities requiring more complex dynamic management yet no 
more sophisticated visual rendering. For example, a swinging door may be 
represented by the triplet "Door Concept, Swinging Door Dynamic, Animated 
10 Entity Visual" whereas a sliding door is represented by "Door Concept, Sliding 
Door Dynamic, Animated Entity Visual". 

It is to be further noted that this entity triplet 10, 12, 14 defines an entity 
type but does not describe the number of Representative Objects instanced to 
model the entity. For each entity instance in the VE a single Conceptual 
15 Representative Object 10 and a single Dynamic Representative Object 1 2 is 
created, however it will be clear that a Visual Representative Object 14 must be 
instanced for each client that may visualise the entity. Hence an entity type is 
defined by the triplet "ConceptualType, DynamicType, VisualType" yet an entity 
instance may be defined by the group "Conceptual Instance, Dynamic Instance, 
20 Visual Instance, Visual Instance, . . . .". 

Figure 2 illustrates one embodiment of a client/server network architecture 
to create a VE including entities represented as discussed with respect to Figure 1 . 

One or more servers are arranged to provide a Rule Manager 20 
(associated with Conceptual Representative Objects 10) and a Dynamics Manager 
25 22 (associated with Dynamic Representative Objects 12) with appropriate 
communication between the respective Rule and Dynamics Managers 20, 22 by 
means of communication channel(s) 21. 

Furt her network connection 23 a llo ws communication w ith one or more 

clients 24 each associated with Visual Representative Objects 14. 
30 Clients 24 therefore communicate dynamic change requests (e.g. the 
movement of a user (represented by a so-called avatar)) to the Dynamics Manager 
(DM) 22 and higher level game related requests (i.e. open door x) to the Rule 
Manager (RM 20). The DM 22 validates changes to the environment, updates the 
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" environment state and broadcasts the changes to the clients 24. The RM 20 
responds to requests by changing the game state and possibly placing requests 
with the DM 22 (e.g. add velocity x to entity y) via the network connection 21 . 

The respective client/server elements might utilise hardware/software as is 
5 indicated below. 

The Rule Manager 20 is provided by a multi processor UNIX workstation 
running a Java virtual machine in a UNIX operating system. (Java implementations 
are available from Sun Microsystems). Java is suitable to implement the RM 20 
insofar as it is one of the most clean and simple 00 programming languages and its 
10 ability to link/interpret new objects during run-time provides maximum flexibility 
when altering the game rules. UNIX machines offer high performance multi- 
threaded Java code and with a single RM 20 controlling each VE the ability to 
increase performance by using multiple processors is useful. 

The Dynamics Manager 22 is run as a multi-processor UNIX workstation. 
15 Since managing the dynamics of the VE is highly computationally intensive a 
powerful multiprocessor system is required, ideally with a very high floating point 
performance to handle the collision calculations. Since modifications will be 
infrequent but speed critical, a compiled language such as C + + is desirable. 

The respective clients 24 may be implemented on any consumer level 
20 games platform which supports 3D graphics and networking. 

The server machines 20, 22 should communicate with each other over a 
high bandwidth/low latency channel 21, for example FDDI or ATM, using a TCP/IP 
protocol stack. rThe client connections 23, whilst potentially low bandwidth, 
should offer consistent latency and bandwidth. Running IP over a dial-in system 
25 over the PSTN using PPP (Point-to-Point Protocol) should, for example, be suitable. 
The architecture is also highly suited to an asynchronous client network 23 such 
as those provided by ADSL technology where the downstream capacity is higher 
than the upstream capacity. 

Figure 3 illustrates messaging interaction between respective clients and a 
30 Rule Managier 20 and Dynamics Manager 22. 

It will be assumed that the implemented embodiment uses a unique 
identifier to represent each entity within the system and that in particular a given 
door entity type may be represented as 'Door Concept, SlidingDoor Dynamic, 
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SlidingDoor Visual'. The implemented embodiment further provides for sequenced, 
reliable message transfer between representatives of the same entity with an 
example message format of the form '< destination entity >, < request >, <... 
optional data ....>'. A particular set of actions that the user can perform on each 
5 Visual Representative Object 14 will be defined. 

As Figure 3 depicts, the Rule Manager 20 will have an instance of a Door 
Concept object 10a, the Dynamics Manager 22 a Sliding Door Dynamic object 12a 
and the clients 24 respective Sliding Door Visual objects 14a. Each will be 
assigned the same identity doorlD. 
10 Referring to the illustrative steps in Figure 3. 

(i) Through a Graphical User Interface (GUI), a user of a first 
client 24' selects the action 'open' from a list of actions permitted in 
respect of the SlidingDoorVisual object 14a shown at the client. 

The SlidingDoorVisual object 14a constructs a message 
15 '<doorlD>, < client action >, <open, from user X>' which is sent 

to the RM 20. The RM delivers the incoming message (1) to its 
version of the door entity, the DoorConcept object 10a, using the 
unique identifier that heads the message. The DoorConcept object 
10a processes the request and, using internal game logic, decides if 
20 user X can, in fact, open the door. 

(ii) Assuming that user X can open the door, the DoorConcept 
object 10a constructs the message '<doorlD>, <open>' and 
sends it (2) to the DM 22, 

The DM delivers the incoming message (2) to its version of the door 
25 entity, the SlidingDoorDynamic object 12a, using the unique 

identifier that heads the message. The SlidingDoorDynamic object 
12a constructs a message for the Visual Representative Objects 14a 
of the form '<doorlD>, <open>, <to position over time ...> '. 

(iii) This message (3) is sent to all clients 24 having the relevant 
30 Visual Representative Object 14a. The Dynamic Representative 

Object 12a will, during a predefined time period, open the door 
whilst checking for collisions with other Dynamic Representative 
Objects. Each client 24 receiving the message (3) from the DM 22 
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^ will route it to their representatives of the entity, the 

SlidingDoorVisual object 14a. 

The object 14a utilises the position and time data indicated in the 
message to animate the door opening with the appropriate visual 
5 effects. 

Should the Dynamic Representative Object 1 2a detect a variation 
from the predicted situation, perhaps caused by collision or the 
destruction of the door, it will generate a new message for the 
clients 24 to update the Visual Representative Objects 14a of the 
10 form <doorlD>, < stop opening >, < at position ..,.> 

It is to be noted that to provide an efficient implementation, the message 
format should be highly optimised rather than the ASCII strings indicated above. 
By way of example, if each of the concept/dynamic/visual representatives has a 
defined, numbered set of requests, the message header becomes a pair of 
15 numbers. The first, the entity id, allows incoming messages to be routed to the 
correct entity representative. The second, the request, allows the relevant method 
on the representative to be called. This can then unpack any additional data 
supplied in the message and implement the required request. 

Implementing the DM 22 as a single server is unlikely to achieve the 
20 desired level of scalability. The vast majority of network traffic generated in a VE 
is related to the dynamics of the environment. Hence a single server could quickly 
form a communications bottleneck. Instead the dynamics management of the VE 
could be implemented to provide scaleability in both the processing load and the 
downstream network traffic to each client. Consequently the dynamics 
25 management is advantageously spread between multiple DMs and hence multiple 
servers. 

Figure 4 shows a preferred second embodiment of the invention based on 

this-approach. 

At the server end a Rule Manager (RM) 20 is provided as per the 
30 embodiment of Figure 1 . Several Dynamic Managers (DMs) 22a, 22b, 22c are 
provided along with a so called World Manager (WM) 26. Whilst the modelling of 
the dynamics of the environment is distributed, this is invisible to the conceptual 
model of the environment. The World Manager 26 provides a routing layer which 



•22/10/97 18:26 u:\patents\word\25431 .dO( 



12 

allows the conceptual model means 20 to message directly to the dynami 
modelling means 22 without having to track the location of the dynamic models in 
the VE. 

Appropriate communication between RM, WM and DMs is provided by 
5 means of respective network connections 21 first between the RM 20 and WM 
26. a second between the WM 26 and each DM 22 and a third between the RM 
20 and each DM 22. 

Again a further network 23 allows communication with one or more 
clients 24 each running a Visual Representative Object. 
10 Whilst multiple DMs 22a, 22b, 22c are required, the RM 20 should still be 

run as a single process. This is desirable as conceptual models may well have 
complex coupling between objects which is independent of their position in the VE. 
For example, a puzzle in a game may involve the use of a series of levers, buttons 
and pressure pads distributed throughout the environment. By contrast dynamic 
1 5 interactions are limited to the area of a VE in which they occur. 

It is possible to run the conceptual model at a single server as the load and 
traffic will be far lower than that associated with dynamic interactions. By way of 
example a moving avatar might be generating 20 position update message a 
second whereas actions performed by a user (flick switch or open a door etc.) will 
20 be relatively infrequent and non-repeating in nature. 

The function of the WM 26, given the requirement for a distributed 
environment to run the dynamics of the VE and a non-distributed environment for 
the conceptual model of the VE, is to provide a routing layer between the DMs 22 
and the RM 20. 

'^^^ 20 has a Conceptual Representative Object 10 for the entities in 
the VE. Each instance represents the conceptual identity of the entity {i.e. a gun 
or a door etc.) but has no knowledge of the location of the entity in the VE. 
Neither does it know where the matching Dynamic Representative Object 1 2 is in 
the distributed dynamic model. In this way the RM 20 is not loaded with traffic as 
30 entities move within the VE. 

The WM 26 knows at a relatively coarse level where the Dynamic 
Representative Objects 1 2 are currently instanced in the distributed dynamic model 
although it does not know their exact position in the VE. Each instanced dynamic 
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^ representative object provides the WM 26 with enough information on its location 
within the distributed dynannic environment to allow the WM to route messages 
from a Conceptual Representative Object 10 associated with the entity (at the RM 
20) to its Dynamic Representative Object 12 (at the relevant DM 22). The format 
5 of this information is dependent on the implementation of the dynamic modelling 
system. 

The DMs instance a Dynamic Representative Object 1 2 for each entity 
allocated to them in the VE. The relevant DM knows exactly where the entity is in 
the VE but does not know what concept that entity represents. A stored state 
10 represents the information required to generate a dynamic physical model of the 
environment. 

The clients 24 maintain a Visual Representative Object 14 for each entity 
within range (visual or aural) of the player's avatar. A stored state provides the 
information required to render each entity and the information required to make 
1 5 requests to the Conceptual or Dynamic Representative Objects. 

The respective client/server elements might utilise hardware/software as 
was indicated above for the previous embodiment with the following additions. 
More than one multi processor UNIX workstation may be used to run the multiple 
Dynamics Managers. 

20 The World Manager 26 may be implemented on a typical UNIX 

workstation. Any suitable fast and efficient UNIX implementation will suffice to 
provide for the routing of messages. 

Figure 5 indicates respective communication channels between managers 
20, 22, 24, 26. 

25 Typically the inter-manager communication channels indicated in Figure 5 

may be used as follows: 

(-1-) — Visual-Representative Objects 14 sending requests from the player 

at a client 24 to their equivalent conceptual object 10 (e.g. "open" for a 

30 door or "pull" for a lever). 

(2) Conceptual Representative Objects 10 sending feedback to the 
player on the results of requests (e.g. "door is locked" for a "open" 
request). 
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(3) Visual Representative Objects 14 sending requests to the Dynamic 
Representative Objects 12 (e.g. ''entity move to x, y, y request"). 

(4) Dynamic Representative Objects 12 updating the Visual 
Representative Objects 14 on information required for rendering the scene 

5 (e.g. "entity position now x, y, z" or "door hinge at angle x"). 

(5) Conceptual Representative Objects 10 sending requests to their 
Dynamic Representative Objects 1 2 relying on the WM 26 to find their 
dynamic equivalent (e.g. "twist door open to angle x"). 

(6) dynamic representatives 12 informing Conceptual Representative 
10 Objects 10 of significant dynamic events. What is considered significant 

is determined by the Conceptual Representative Object 10 and it selects 
events by adding sensors to the dynamic representative (e.g. 
GlassSheetConcept object adds collision sensor to its dynamic equivalent 
GenericltemDynamicObject. Hence when the dynamic item is struck the 
15 conceptual item is informed (6) and can handle the consequences 

accordingly). 

(7) WM routing requests from the Conceptual Representative Objects 10 
(5) to their dynamic equivalents 1 2 (7) (e.g. "twist door open to angle x"). 

(8) Dynamic Representative Objects 1 2 registering a means of 
20 messaging to them. This channel is unnecessary in a simple non-scaleable 

architecture where a single DM is used. 

All communications channels must be reliable. However, channels (3) and 
(4) may be supplemented with an unreliable data stream which may be useful for 
25 appropriate classes of message. A first circumstance might relate to messages 
that are frequently repeated and contain data that is time sequence independent. 
For example, position updates which, provided each update is part of a continuous 
sequence of updates, may be occasionally dropped without affecting the long term 




consistency of the VE. A second circumstance might relate to messages that are 
30 non-critical and make no permanent state change to the VE. For example, a 
message to instruct an avatar to wave a hand or to blink might be considered. 

The dynamic model as outlined above is responsible for a number of tasks 
including the storing of the dynamic state of the environment (defined as the sum 
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^ of the states of all the Dynamic Representatives), providing clients 24 with initial 
information required to build the necessary Visual Representative Objects 14, 
updating the state of the Dynamic Representatives over time (e.g. the velocity of a 
Dynamic Representative Object may need a new position repeatedly calculated) 
5 and the distribution of required state updates to visual and Conceptual 
Representative Objects (e.g. as a moving Dynamic Representative Object updates 
its position, its visual counterpart will need to be informed of the new position to 
ensure accurate rendering of the scene). 

The design of the dynamic model thus has to address at least three areas. 

10 The first area is consideration of delivery of the initial state. On connection, the 
client will need to be billed a visual representation of the current dynamic state. 
With potentially thousands of entities, all possessing unique state {position, 
orientation, visual description etc.) this initial state download could be a lengthy 
process over a low bandwidth link (e.g. 28.8 kbits per second modem on PSTN). 

15 A preferred design should therefore attempt to minimise this initial download 
period. 

The second area is the consideration of the distribution of state updates. 
Clients need to ensure that they are visually representing an accurate description 
of the current dynamic state. However, with numerous 

20 DynamicRepresentativeObjects frequently updating state (moving, rotating and 
colliding etc.) this may generate a large amount of information exchange. A 
preferred design should also therefore attempt to minimise the volume of state 
update delivered to each client. 

The third key area to address is consideration of the updating of states. 
25 Computing the necessary dynamic state updates can be computationally highly 
expensive and represents a potential limit on the number of entities represented in 
the dynamic model. Consequently a preferred design should attempt to distribute 

^this-load-amongst multiple processors. 

A proposed architecture for addressing these issues is depicted in Figure 

30 6. 

A Rule Manager 20 and at least one client 24 are present as with respect 
to earlier embodiments of the invention. 
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A World Manager 26 is likewise presented as discussed with reference t 
Figure 4 but the one or more dynamics managers 22 are provided as one or more' 
zone managers 28 associated with a persistent objects store 29. 

As before the Rule Manager 20 will instance and provide processing time 
5 for the various Conceptual Representative Objects 10 within the environment. 
Likewise the clients 24 will instance and provide processing time to all the Visual 
Representative Objects 14 within the associated avatar area of interest. 

The World Manager creates Zone Managers 28 as required, synchronises 
closure and start up of Zone Managers 28 and routes messages to the Dynamic 
10 Representative Objects 12 from the Conceptual Representative Objects 14 whilst 
providing load management. 

Each Zone Manager 28 instances and provides processing time to all 
Dynamic Representative Objects 12 within a particular allocated zone. Each Zone 
Manager is created by the World Manager 26 to manage zones with dynamic 
15 activity and will be closed down when dynamic activity in the assigned zone 
ceases. The persistent object store 29 provides storage facility for the Dynamic 
Representative Objects 12 within closed zones (i.e. zones with no zone manager 
allocated). 

The Virtual Environment may thus be thought of as divided into a number 
20 of predefined volumes denoted as zones. Zones do not overlap but are laid out in 
such a way as to encompass the entire volume of the environment. Hence a 
selected point within the environment is always attributable to one and only one 



4 



zone. 



All Dynamic Representative Objects 1 2 have a single assigned zone at an 
25 instant in time. The actual zone in which a DynamicRepresentativeObject is placed 
is determined from its position in the VE. The state of the zone is defined as the 
sum of all the Dynamic Representative Objects 1 2 within the zone. The state of 
the environment is then defined as the sum of the state of all of its zones. 

Zone shapes can either be regular and identical for all zones or may be 
30 based around the design of the environment itself. For example a simple sub- 
division of the environment might simply overlay a square grid over a horizontal 
plane and specify each zone as extending to infinity in the vertical direction. A 
more complex approach might sub-divide the virtual environment on the basis of its 
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^ contents so the volunne of a corridor would form one zone whilst the volunne of an 
adjoining room would form another zone. 

Figure 7 illustrates two variations on sub-dividing a small environment 
(viewed from above). 

5 Figure 7A shows six zones 70 placirig a Dynamic Representative Object 

12 (a) in zone 1, (b) in zone 4, (c) in zone 2, (d) in zone 3 and (e) in zone 5. Note 
that whilst the volume of a Dynamic Representative Object 10 can overlap zone 
boundaries (e.g. (b) in Figure 7A) the origin of the representative can always be 
uniquely attributed to one zone (e.g. Zone 4 for (b) in Figure 7A). 

10 Figure 7B shows the same environment with the Dynamic Representative 

Objects 10 in the same locations but with four zones to perform the sub-division. 
This places Dynamic Representative Objects (a) and (b) in zone 1 and (c) (d) in 
Zone 3 and (e) in Zone 4. 

It will be clear that the use of Zones 70 and Zone Managers 28 in this 

15 fashion offer possible solutions to the problems outlined above. 

The problem of distributing the computational load for example will be 
resolved by maintaining and updating the dynamic state on a zone by zone basis. 
Each zone as indicated above will be associated with a process, termed the zone 
manager which will be responsible for generating time related state changes to the 

20 dynamic model (e.g. updating positions of objects with velocity), validating 
changes to the dynamic model (e.g. ensuring requests to move Dynamic 
Representative Objects from Visual or Conceptual Representative Objects are valid 
and do not cause Dynamic Representative Object volumes to overlap in a collision) 
and distributing changes to the dynamic model (e.g. updating relevant clients with 

25 new dynamic state after either of the above two events). 

The division of computational load between numerous zone manager 
processors allows the environment size complexity to be scaled by increasing the 

number of processors -available. Whilst -neighbouring zones must be closely 

coupled so that boundary conditions are correctly handled (Dynamic Representative 

30 Objects moving across and placed close to zone boundaries) no coupling is needed 
between non-adjacent zones. Hence, whatever the environment size the load on 
each zone manager is proportional to the dynamic modelling requirements of its 
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^ localised area (i.e. the Dynamic Representative Objects in its allocated zone plus 
it's immediate neighbours). 

The use of zones also helps to reduce the amount of network traffic 
delivered to each client on initial connection and throughout the connection period. 
5 This is achieved by considering clients to have an area of interest centred around 
their avatar. Within this area of interest the clients will need both the initial state 
of all the Dynamic Representative Objects and the state updates to all Dynamic 
Representative Objects. Outside this area of interest neither initial state nor state 
updates will be required. 

10 For example if an avatar is placed next to a bouncing ball the avatar's 

client will need to be told both the starting position of the ball and each new 
position if it is to correctly display the balls dynamic motion via a Visual 
Representation Object. In practice, a client may only be occasionally updated on 
the position of the ball and, between updates, predict the motion locally. If the 

15 bouncing ball is moved sufficiently far away from the avatar so that it is no longer 
in the client's visual range neither initial state nor state updates are now required. 
Since the player will remain unaware of the ball, the client can be as well. 

In the zoned division of the environment, the client's area of interest 72 is 
defined as the area of the zone 70 in which its avatar is plus the area of all the 

20 immediately surrounding zones. Figure 8 illustrates this for an environment 
utilising the simple zoning strategy of square zones extending to infinity in the 
vertical direction. 

Each zone 70 has an associated state (the state of the Dynamic 
Representative Objects within it) and an associated amount of network traffic (the 

25 message describing changes to the Dynamic Representative Objects). To maintain 
a complete model of the virtual environment at each client 24 would require that 
the state and associated network traffic of all zones be delivered to each client. 
However, through the use of avatar area of interest 72, the demands on each 
client can be constrained to the state and associated traffic of the zones local to 

30 its avatar. Hence the load placed on the network link 23 to the client becomes 
proportional to the activity in the environment 72 local to the client's avatar and 
not proportional to the environment's total size or complexity. 
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^ On creation of an avatar Dynamic Representative Object (for example as 

represented by A in Figure 8) the initial state of the zones in the surrounding area 
of interest 72 can be delivered to the client associated with that avatar. The client 
is then termed to be "shadowing" these zones and, as their dynamic state 
5 changes, the associated zone manager informs the client. As the client's avatar A 
crosses a zone boundary 74 new zones 76 will come into its area of interest 72. 
The client then receives the initial state of the new zones and begins to shadow 
these zones as is illustrated in Figure 9. As the avatar then moves away from the 
zone boundary it will stop shadowing the zones 78 now lying outside of its area of 
10 interest 72. 

It is important that in the interest of efficient network utilisation this 
cessation of shadowing should not occur immediately a zone boundary 74 is 
crossed. By ceasing shadowing, the client becomes blind to any state changes 
within a zone 70 and hence on reconnection must fetch the complete state. An 
15 avatar oscillating over a zone boundary 74 with immediate halting of the 
shadowing would cause zone state descriptions to be repeatedly sent. In contrast 
if shadowing is not dropped immediately unnecessary fetching of initial states is 
avoided at the cost of an increased area of interest 72. 

It is to be noted that this approach of zone shadowing is highly efficient in 
20 determining if the client needs the dynamic updates to a particular representative 
object. Each time a Dynamic Representative Object 12 needs to distribute a state 
change to its Visual Representative Objects 14 It sends messages to all clients 24 
shadowing the zone in which it is currently located. These clients by virtue of 
their shadowing status will have an instance of the visual representative object 14 
25 and hence will require the information. 

On a client's 24 initial connection to the virtual environment the amount of 
state information downloaded is now reduced to the state of the zones in the area 

of—interest— 72— surrounding_the-player's avatar. The time this takes will be 

proportional to the number of Dynamic Representatives in the avatar's immediate 
30 locality. However, it will not be proportional to the actual size of the world or the 
total number of dynamic representatives. 

Since the environment's Dynamic Representative Objects are now 
distributed amongst a number of processors (Zone Managers 28 as shown in 
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Figure 10), it is necessary to provide a means of routing messages from the Rule 
Manager 20 to the appropriate Zone Manager 28. Since the Rule Manager 20 is 
not aware of dynamic state changes, as the dynamic objects move through the 
environment and hence from zone to zone the Rule Manager is unable to determine 
5 which Zone Manager the associated Dynamic Representative Object currently 
resides on. 

The necessary routing is performed by the World Manager 26 which tracks 
the zone location of all Dynamic Representative Objects 12. As each Dynamic 
Representative Object moves into a new zone 70 either after creation or on 
10 crossing a zone boundary 74, the relevant Zone Manager 28 informs the World 
Manager of the identity of the current zone. This should not represent an 
excessive load on the World Manager 26 as the level of position tracking is very 
coarse (dependent on zone size). 

After starting a zone 70, (a process that will be discussed in greater detail 
15 below), the World Manager 26 establishes a network connection 21 to the relevant 
Zone Manager as is illustrated in Figure 10. On receiving a message for a 
particular Dynamic Representative Object the World Manager looks up the Dynamic 
Representative Object's current location and delivers the message to the 
appropriate Zone Manager 28. The Zone Manager then handles delivery to the 
20 appropriate Dynamic Representative Object 12. 

It is to be noted that if a Dynamic Representative Object is leaving a zone 
70 at the same time that the World Manager 26 attempts to deliver a message to 
it, the message may arrive at the Zone Manager after the representative object has 
switched zones. In this case the Zone Manager may return the message as "lost" 
25 and the World Manager handles the routing of the message on to the new location. 

Each Zone Manager 28 is arranged to maintain a connection 30 to all its 
neighbouring Zone Managers as illustrated in Figure 1 1 . These connections 
between Zone Managers 28 enable Dynamic Representative Objects to be handled 




between Zone Managers as they cross zone boundaries. In the situation when a 
30 Dynamic Representative Object requests to move to a position outside of its Zone 
Manager's defined area of management the request is delegated to the appropriate 
neighbouring Zone Manager. If the request can be completed (i.e. the requested 
location does not cause a collision) the state of the Dynamic Representative Object 
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^ is sent to the new Zone Manager and the new version of it instantiated there. It is 
to be noted that in this situation it may be necessary for the original Zone Manager 
to request the World Manager to start the destination zone if it is not already 
running, a process again as will be discussed in greater detail below. 
5 The zone interconnections 30 are also required to ensure the correct 

handling of collision detection and zone boundaries. Figure 12 illustrates a problem 
that may arise when two Dynamic Representative Objects A and B are colliding 
whilst in adjoining zones and hence instanced on different Zone Managers. If 
neither Zone Manager is aware of the other's dynamic state this collision will not 

10 be detected. Each Zone Manager therefore "shadows" the dynamic state of all its 
neighbouring zones. This is achieved by each Zone Manager 28 instancing a 
shadow version of all Dynamic Representative Objects in neighbouring zones. 
These shadow representatives are available for collision detection but are not 
responsible for generating updates to their dynamic state. As the "master" 

15 Dynamic Representative Object (i.e. the one within the zone allocated to the 
instancing Zone Manager) changes dynamic state it informs both its Visual 
Representative Objects and its shadow Dynamic Representative Objects. A Zone 
Manager is termed to be the master of its designated zone whilst shadowing the 
dynamic state of its neighbouring zones. 

20 This master/shadow approach when applied to Figure 12 would mean that 

the Zone Manager 28 of Zone 1 would be the master of A and the shadow of B 
and Zone Manager of Zone 2 would be the master of B and the shadow of A. As 
A (Master) updated a dynamic state it would use the inter-zone network 
connection 30 (as shown in Figure 11) to inform its A (shadow) on Zone Manager 

25 2. Hence, B (Master) will detect the collision situation with A (shadow) and 
rebound appropriately. Likewise, A (Master) will be able to detect the collision 
with B thanks to its local instantiation of B (shadow). 



It is unlikely to be feasible simultaneously to provide a Zone Manager 28 for every 
30 zone within the environment. An environment divided into a grid of 1000x1000 
zones would require 1,000,000 Zone Managers if they were created on a manager 
per zone basis at system start-up. This would represent an unsupportable overhead 
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on an operating systenn, even if the Zone Managers were distributed over 
numerous machines. 




10 



30 



By default all zones 70 of the virtual environment are designated closed at system 
start-up, with no Zone Manager allocated, and the state of the initial dynamic 
representatives are placed in the persistent object store 29 {grouped by zone). The 
World Manager 26 scans this persistent store 29 at start-up to determine the 
location of all dynamic representatives. This allows it to perform the initial routing 
from conceptual to dynamic representatives. 



Zones are started (i.e. allocated to a Zone Manager 28) when: 

1) a conceptual representative 10 needs to message to a dynamic 

representative 12 in a closed zone (i.e. one which has no Zone Manager allocated); 
or 

15 2) a conceptual representative 10 needs to message to a particular zone 70, 

and the zone is currently closed. This may be necessary when a conceptual 
representative 10 needs to create its dynamic counterpart at a specific location in 
the environment; or 

3) a dynamic representative on a neighbouring zone 70 wishes to move into a 

20 zone that is currently closed e.g. an avatar throws a ball across a zone boundary 
74 from a started zone into a closed zone. 

Cases 1 and 2 above can be detected by the World Manager 26 when performing 
routing for the Rule Manager 20. Case 2 is handled by simply checking if the 
25 requested zone is running (i.e. has been started), starting it if necessary, and then 
forwarding the message to it. Case 1 requires the World Manager 26 to look up 
the current zone of the requested dynamic representative (as stored in the 
Persistent Object store 29), start that zone if it is not already running, and then 
forward the message on. 



Case 3 is handled in a different way, and relies on allowing running Zone Managers 
to request one of their neighbouring zones be started. A Zone Manager, on 
detecting that a dynamic representative needs to move into a currently closed 
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^ zone, sends the request to the World Manager. The World Manager perfornns the 
creation process and the original Zone Manager will receive a connection from the 
new Zone Manager as it starts. 

5 The start-up process for a Zone Manager 28 is as follows: 

• Establish network connection from World Manager 26 to a zone manager 28. 

• Receive allocated zone identity from World Manager, and extract current state 
of zone from the persistent object store 29. 

• Instance all dynamic representatives within allocated zone from extracted state 
10 description. 

• Receive identity of neighbouring zones, and, for those neighbours currently 
started, receive an address suitable to establish a network connection. 

• For all neighbouring zones not started, extract their current state from the 
persistent store and use this to instance their shadow dynamic representatives. 

15 • For all neighbouring zones started, connect to them, receive their current state, 
and use this to instance their shadow dynamic representatives. 

• Connect to all relevant clients 24 (i.e. All those with avatars in the local area). 

• Inform World Manager 26 that zone start-up is complete. 

20 On starting a Zone Manager, the World Manager 26 ensures that all the 
neighbouring Zone Managers are neither closing or starting. If adjacent zones are 
allowed to start or close together, unwanted situations develop with respect to 
forming inter-zone connections and accessing states from the persistent store 29. 



25 The World Manager 26 can perform coarse load balance by distributing the 
creation of zone managers amongst the available servers. This distribution could be 
based on selecting the server with the lowest processing load in which to create 
~~ new zone~~managers processes. Alternatively data such as the geographical 
relationship between zones could be factored in. e.g. zone managers handling 

30 adjacent zones may be held on the same server, in order to minimise their inter- 
zone communication delays. 
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An example implementation of this load balancing is shown in Figure 13. The Rul 
Manager 20, the World Manager 26 and the persistent object store 29 are held on 
a first server 40. Also held locally are two Zone Managers 28. A second server 
42 holds four Zone Managers 28 and a third server 44 holds three Zone Managers 
5 28. On each server, a mother processor 46 is held which is responsible for 
creating new Zone Manager processes (i.e. opening and closing) and reporting the 
average processor load on its particular server to the World Manager 26. On 
creation of a new zone manager 28 the world manager can query the available 
mothers to determine the least loaded one. It then delegates the responsibility of 
10 creating the zone manager to the appropriate mother, which generates it as a child. 

If the creation of Zone Managers was allowed to continue indefinitely the 
Operating System overhead in maintaining large numbers of processes would 
become too great. It is therefore preferable to detect when it is possible to close a 
1 5 zone down and place its state back in the persistent store. The criteria for when a 
zone should be closed down will depend on factors such as: 
the type of environment modelled; 

the spare processing capacity of the processors supporting the Zone 
Managers; and 

20 the amount of time elapsed since activity last occurred in the zone. 

If data has been accessed recently it is likely to be accessed again soon 
afterwards, and data close to it is also likely to be accessed. Similarly, if there is 
activity in one area of the VE there is likely to be both activity in the same area 
again soon and activity in adjacent areas. 

25 

The criteria for when a zone can close down is easier to define; a zone can close 
when it has become dynamically deterministic. This means that any client or 
manager with an interest in the dynamic description of the zone can predict the 
zone's future state from its current state, and hence the Zone Manager no longer 
30 has a role. In this situation the Zone Manager 28 can write its current state back 
into the persistent store and then terminate. 



Conditions that prevent a zone being considered dynamically deterministic include: 
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" the presence of any dynamic representative whose position and orientation are 
under the control of a client (an avatar for example). In this situation any changes 
the client will attempt to make to the dynamic state will need to be validated and 
possibly broadcast by the Zone Manager; and the presence of any dynamic 
5 representative in non-constrained motion (e.g. a thrown item). In this case the 
future positions of the representative depend on collision calculations, which are 
performed by the Zone Manager, 

Note that the last condition does not preclude a zone from closing whilst it has 
10 dynamic representatives that are in motion. For example, if a dynamic 
representative continually oscillating between two fixed points is dynamically 
deterministic (constrained motion), the zone may close provided its visual 
representative or the clients can handle predicting its motion. 

15 On determining that a zone both can and should close, the Zone Manager goes into 
the following sequence: 

• Obtains confirmation from the World Manager 26 that it can close down. This 
may be denied if any of the zone's neighbours are currently starting or closing. 

• Obtains confirmation from each of its neighbouring Zone Managers 28 that 
20 closing the inter-zone network link 30 is valid. This may be denied if a 

neighbouring Zone Manager has dynamic representatives attempting to move 
into the zone attempting to close. 

• Writes the state of all the dynamic representatives into the persistent object 
store 29 and terminates. 



25 



30 



If any stage of the closed down sequence fails the Zone Manager 28 unwraps the 
sequence, re-connecting closed network connections 30, fetching the dynamic 
state of any neighbours with which it lost contact and cancelling the closure 
operation with the World Manager. 

Clients need to be supplied with enough information to instantiate all the necessary 
visual representatives within their avatar's area of interest 72. To do this network 
connections 23 must be formed between a client 24 and all the running Zone 
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^ Managers 28 within its area of interest 72. Responsibility for forming these 
connections can be allocated to either the Zone Managers 28 or the Client 24 
itself. 

5 Zone Manager To Client Approach. This approach assumes the client's network 
address is available as part of the state of the each avatar's dynamic 
representative. As a Zone Manager 28 instantiates an avatar (either the master or 
shadow version) it extracts the client address from the avatar and connects to the 
client. It can then deliver the necessary state information to allow the client to 
10 instantiate all the necessary visual representatives, and update this state as 
required. It is then the responsibility of the client to terminate the connection to 
this zone, normally performed when its avatar has moved to a non-adjacent zone. 




An example of this approach to forming client connection is illustrated in Figure 
15 14. 

1) In Figure 14a, Zones 2,6 and 8 are running, the rest of the zones being 
closed. An avatar A is to be introduced into zone 5. 

2) The message from a client 24 to create the avatar's dynamic 
representative will cause the World Manager 26 to start a Zone Manager 28 for 

20 zone 5. This will instantiate the master version of the avatar's dynamic 
representative A (Figure 14b), and tell neighbouring zones 2 and 6 to create a 
shadow version. All three Zone Managers (for zones 2, 6 and 5), on detecting the 
introduction of an avatar, will then connect out to the client 24 associated with 
the avatar, and supply their current state. The avatars area of interest 72 also 

25 includes zones 1, 9 and 10, and the client 24 therefore also requires the 
description of the current state of these zones. Since they have no designated 
Zone Managers to perform this function, the task is delegated to the Zone Manager 
instantiating the master version of the dynamic representative. Hence in this case 
Zone Manager 5 will supply the current state of zones 1,9 and 10 to the client. 

30 Note that this does not require Zone Manager 5 to access the state placed in the 
persistent object store, as it will already have fetched the current state description 
to perform zone shadowing. 
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^ 3) In Figure 14c the player has moved the avatar A into zone 6. This causes 

Zone Managers 5 and 6 to swap master/shadow responsibility for the dynamic 
representative of avatar A. The avatar's area of interest now incorporates zones 3, 

7 and 1 1 . Since these are closed zones, on becoming the master of the dynamic 
5 representative Zone Manager 6 will supply their current state. 

4) In Figure 14d the player has moved the avatar A into zone 7. Since zone 7 

was closed, on attempting to move the master dynamic representative into zone 7, 
Zone Manager 6 requests the World Manager 26 to start zone 7. On creation of 
the master dynamic representative on Zone Manager 7, a shadow version will also 
10 be created on Zone Manager 8. Both of these Zone Managers will then connect out 
to the client 24, using the network address embedded in the avatar. Zone Manager 

8 will deliver its current state to the client and Zone Manager 7 will supply the 
state description of zones 4 and 12. It will not supply its own state description, as 
the client as already been provided with this from Zone Manager 6. When the 

15 client determines its avatar is sufficiently far from the zone 6/7 boundary it will 
drop the connection to Zone 5 and delete any associated state. 



Note that the above description presumes a non-optimised solution. Various 
improvements could be made to reduce the amount of information transmitted to 
the client e.g. cache the zone state at the client and only provide updates if the 
client's cached state differs from the actual state. This would prevent repeated 
downloads of the state of zones that have remained closed, and hence unchanged. 
Improvements could also be made to optimise the movement of dynamic 
representatives across zone boundaries e.g. predict when an avatar is expected to 
enter a closed zone and place a request to start the appropriate zone with the 
World Manager 26 in advance. 



The-alternative to-the-above-approach,~where-zone-manager-S"take-responsibility-for- 
ensuring clients are connected to, is to move the responsibility to the clients 
30 themselves. This requires that, when the avatar's conceptual representative 
creates the dynamic representative, it also informs the client of the address of the 
Zone Manager on which the dynamic representative is instantiated. The client can 
then connect to this Zone Manager, and request that it supply: the state of all 
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^ closed neighbouring zones; and the address of the Zone Manager(s) for all running 
neighbouring zones. The client can then form connections to all running Zone 
Managers in its area of interest 72. As the dynamic representative moves between 
zones the process can be repeated, allowing the client to maintain connections to 
5 all Zone Managers within its area of interest. 

The advantage of this approach is that clients are not limited to fixed areas of 
interest. Dependent on the bandwidth available, the activity within the 
environment and the type of environment, the client may wish to either expand or 

10 contract its area of interest by varying the number of Zone Manager connections. 
By contrast the alternative approach, with Zone Managers forming the connections 
to clients, fixes the area of interest to the zone the avatar is currently in together 
with its neighbours. However, by placing connection responsibility at the Zone 
Manager, client queries of zone started/closed state (with the associated delay and 

15 bandwidth usage this entails) are avoided. Connections to clients are made 
automatically when a Zone Manager detects the presence of an avatar. 

One possible enhancement to the architecture suggested in Figure 6 Is to associate 
a multi-cast address with each Zone Manager 28, and hence each running zone. 

20 Each client, on forming a connection with a Zone Manager, would also connect to 
the associated multi-cast address. This would allow temporary visual effects to be 
communicated between clients without placing a load on the Zone Manager. For 
example, making an avatar wave its hand in greeting is a one off visual effect, 
making no permanent change to the VE state. The instruction to perform this 

25 action could therefore be distributed via the multi-cast address associated with the 
avatar's current zone. This would ensure all clients, whose area of interest 
encompassed the avatar's zone, received the instruction. The avatar's visual 
representative on each client would then perform the hand wave visual effect. 

30 The provision of a multi-cast address would also provide an unreliable distribution 
mechanism for the Zone Manager. The Zone Manager to Client connections 23 
discussed earlier are all assumed to be reliable to ensure the client receives an 
accurate description of the Initial state. However, state updates that are repeating 
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^ in nature (e.g. position updates of a moving object) need not be delivered in a 
reliable manner. Provided the final update is delivered reliably and the visual 
representative offers a degree of prediction and interpolation, missing an 
intermediate update should not present a problem. 

5 

Once running, a Zone Manager 28 has the following responsibilities: 

• Maintain a list of network connections that require updates to the dynamic state 
delivered to them. This list is used by the dynamic representatives (instantiated 
on the Zone Manager), to distribute any changes to their state. The list will 

10 consist of clients whose area of interest intersects the zone and the Zone 
Managers assigned to neighbouring zones. 

• Deliver messages originating from conceptual representatives 10 in the Rule 
Manager 20 (routed via the World Manager 26), to the appropriate dynamic 
representatives 12. 

15 • Deliver messages originating from visual representatives 14 to the appropriate 
dynamic representatives 12 (e.g. Updates to avatar position). 

• Provide shadowing of the dynamic state of all neighbouring zones. 

• Provide collision detection facilities to dynamic representatives, allowing them 
to test the validity of new positions. 

20 • Provide processing time slices to any dynamic representative that requests 
them. For example, a ball bouncing through the environment will need to 
regularly re-calculate its position and test new positions for collisions. 

• Synchronise hand-over of dynamic representatives between Zone Managers, as 
the representatives cross zone boundaries. 

25 • Monitor zone state for valid conditions to close the zone down. 



'22/10/97 18:26 u:\patents\word\25431.doc 



30 

^ CLAIMS 

1 . Apparatus for providing a client/server based virtual environment wherein 

each entity in the virtual environment is represented as a plurality of associated 
5 aspects of the entity, the apparatus comprising: 

at least one server comprising rule model managing means to provide a 
conceptual model of an entity and at least one dynamic model managing means to 
provide a dynamic model of the entity; 

at least one client comprising visual model managing means to provide a 
10 visual model of each entity; and 

means to allow messaging between respective ones of the rule model 
managing means, the dynamic model managing means and the visual model 
managing means to ensure consistency. 

15 2. Apparatus according to claim 1 wherein the means to allow messaging 

includes an unreliable messaging means. 




3. Apparatus according to claim 1 or 2 in which the dynamic model managing 

means is distributed over a plurality of servers, a central environment managing 
20 means being provided to manage the messaging between the distributed dynamic 
model managing means. 




4. Apparatus according to any of claims 1 to 3 in which the dynamic model 

managing means comprises a plurality of zone managing means, each zone 
25 managing means providing a dynamic model of an entity present in a zone of the 
virtual environment associated with the zone managing means. 



5. Apparatus according to claim 4 which is arranged to start and close a zone 

managing means in response to the behaviour of a dynamic model in the 
30 associated zone. 



6. Apparatus according to claim 4 or 5 in which the clients are arranged to 

establish connections to the zone managing means representing the zone of the 
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^ client and to the zone managing means representing the zones surrounding the 
zone of the client. 

7. Apparatus according to any of claims 1 to 6 wherein the dynamic model 
5 managing means provides a multi-cast address for at least one dynamic model of 

an entity of the virtual environment. 

8. Server apparatus for a client/server based virtual environment wherein 
each entity in the virtual environment is represented as a plurality of associated 

10 aspects of the entity, the server apparatus comprising: 

rule model managing means to provide a conceptual model of an entity 
and at least one dynamic model managing means to provide a dynamic model of 
the entity; 

means to allow messaging between respective ones of the rule model 
15 managing means, the dynamic model managing means and visual model managing 
means located on at least one client to provide a visual model of each entity; 

9. Client apparatus for providing a client/server based virtual environment 
wherein each entity in the virtual environment is represented as a plurality of 

20 associated aspects of the entity, the apparatus comprising: 

at least one client comprising visual model managing means to provide a 
visual model of each entity; 

means to allow messaging between the visual model managing means and 
at least one server comprising rule model managing means to provide a conceptual 
25 model of an entity and at least one dynamic model managing means to provide a 
dynamic model of the entity. 

10. A method of providing a client/server based virtual environment wherein 
each entity in the virtual environment is represented as a plurality of associated 

30 aspects of the entity, the method comprising: 

providing a conceptual model of the entity, a dynamic model of the entity 
and a visual model of the entity; 
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storing, on at least one server, the conceptual model of an entity in rule 



model managing means and the dynamic model of the entity in at least one 
dynamic model managing means; 

storing, on at least one client, the visual model of each entity in visual 
5 model managing means; and 

messaging between respective ones of the rule model managing means, 
the dynamic model managing means and the visual model managing means. 



22/10/97 18:26 u:\patents\wopd\25431j 




33 

^ ABSTRACT 

DISTRIBUTED VIRTUAL ENVIRONMENT 

Apparatus for providing a client/server based virtual environment wherein 
5 each entity in the virtual environnnent is represented as a plurality of associated 
aspects of the entity, the apparatus connprising: at least one server comprising rule 
model managing means (20) to provide a conceptual model (10) of an entity and at 
least one dynamic model managing means (22) to provide a dynamic model (12) of 
the entity; at least one client (24) comprising visual model managing means to 
10 provide a visual model (14) of each entity; and means (21, 23) to allow messaging 
between respective ones of the rule model managing means(20), the dynamic 
model managing means (22) and the visual model managing means (24) to ensure 
consistency. 
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